Interacting with cloud-based applications using unrelated devices

ABSTRACT

Systems and methods provide logic facilitating an interaction between a networked server and multiple, unrelated devices. In one implementation, a computer-implemented method enables a user of a device to interact with or control multiple, unrelated devices across a cloud computing environment using a networked server. The method includes receiving, at the networked server, an instruction from the control device. A corresponding instruction understandable by an unrelated controlled device is generated by the networked server, and the corresponding instruction is operable to cause the controlled device to perform the received instruction. The networked server may transmit the corresponding instruction to the controlled device.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. patent application Ser. No.12/890,244, entitled INTERACTING WITH CLOUD-BASED APPLICATIONS USINGUNRELATED DEVICES, and filed Sep. 24, 2010, the entirety of which isincorporated by reference herein.

BACKGROUND OF THE INVENTION

Online entities offer a wide variety of electronic content and servicesto a variety of different devices, including personal computers (PCs),electronic book viewers, portable digital assistants (PDAs), mobiletelephones, pocket PCs, smart phones, televisions, set-top boxes,digital video recorders (DVRs), and gaming consoles. These devices oftenaccess various web pages and web services, such as those associated withonline stores or other providers of audio/visual content, softwareprograms, digital books, or other electronic content.

For example, high resolution televisions, such as those incorporatingLCD and plasma technologies, are now capable of connecting to theInternet and accessing electronic resources of a cloud computingnetwork. Such resources, which include services that stream digitalvideos, services that stream output of electronic games, and servicesthat provide access to stored digital images and videos, areparticularly suited to the large-scale, high-resolution displays ofmodern LCD and plasma televisions. However, despite advances in displaytechnology, such televisions are often controlled by related devices,such as remote controls that come with the television. Moreover, otherdevices are also often controlled by related devices that are includedwith, or provided as part of, the devices. For example, alarm systemsand other household appliances do not provide users with the ability tocontrol these devices separately from related controls either built-into the devices or included with the devices.

In view of the foregoing, there is a need for improved systems andmethods for controlling a device without being required to use a relateddevice that is specific to the device being controlled.

BRIEF DESCRIPTION OF THE DRAWINGS

The accompanying drawings, which are incorporated in and constitute apart of this disclosure, illustrate various disclosed embodiments. Inthe drawings:

FIG. 1 is a diagram of an exemplary architecture of a system;

FIG. 2 is a flow diagram of an exemplary routine enabling a first deviceto deliver content to an unrelated device;

FIGS. 3A and 3B illustrate exemplary user interfaces;

FIG. 4 is a flow diagram of an exemplary routine enabling a first deviceto modify an operational state of an unrelated device;

FIGS. 5A-5D illustrate exemplary user interfaces;

FIG. 6 is a flow diagram of an exemplary routine facilitatinginteraction between a server and unrelated devices;

FIGS. 7A and 7B exemplary user interfaces that facilitate the tagging ofcontent using multiple devices;

FIG. 8 illustrates an exemplary configuration of a system includingmultiple, geographically-dispersed users; and

FIGS. 9A-9C depict exemplary content associated with an interactive quizgame.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT

Disclosed systems and methods enable a user of a first device tointeract with and control one or more additional, unrelated seconddevices within in a cloud computing environment using a networkedserver. The user of the first device executes a widget, plug-in, orother application program to generate an interface on the first device.Using the interface, the user generates a request to interact with orcontrol an unrelated second device, and an instruction including therequest is transmitted from the first device to the networked server.For example, the user may request a delivery of electronic content tothe unrelated second device, a change in an operational state of theunrelated second device or an interaction with a user of the unrelatedsecond device, or with users of similar unrelated devices, within thecloud computing environment. Based on the instruction from the firstdevice, the networked server generates a corresponding instruction thatis compatible with the unrelated second device, and transmits thecorresponding instruction to the unrelated second device. Afterreceiving the instruction, the unrelated second device performs anaction consistent with the instruction received from the first device.For example, the unrelated second device may retrieve content at a timeor date consistent with the instruction, or alternatively, may modifyits operational state consistent with the instruction.

As an example, a user of an iPhone or a Blackberry may execute a widgetto generate an interface associated with a video-on-demand service or aweb-based television service. Through the interface, the user mayschedule a recordation of electronic content to an unrelated digitalvideo recorder (DVR) within the cloud computing environment. Forexample, the interface may be generic and may not be tied to aparticular brand of DVR. Thus, the interface may only request that theuser enter a time and date of the desired recording or a name of atelevision program. The networked server may translate the request intoa format understood by the user's DVR. Upon receipt of the instruction,the unrelated second device may record the television program inaccordance within the instruction.

In an additional example, the user of the iPhone or the Blackberry mayexecute a widget to generate a corresponding interface, and through theinterface, the user may request a change in an operational state of anunrelated device within the cloud computing environment. For example,the user of the iPhone or Blackberry may request an activation ordeactivation of a home security system or home appliance at a selectedtime or date. Additionally, the interface may allow the user of theiPhone or Blackberry device to specify a threshold temperature at whichan electronic thermostat activates a heating or cooling device. Once theuser specifies the requested modification, the iPhone or Blackberry maytransmit an instruction including the request to the networked server,which may forward a corresponding instruction to the unrelated device.Upon receipt of the instruction, the unrelated device may modify itsoperational state in accordance with the request.

As another example, the user of the iPhone or Blackberry may participatein an electronic gaming application with one or moregeographically-dispersed users of unrelated devices within the cloudcomputing environment. As yet another example, the user of the iPhone orBlackberry may select an element of audio-visual content displayedthrough a corresponding interface, and may coordinate with the networkedserver to schedule delivery of additional electronic content associatedwith the selection to one or more unrelated devices within the cloudcomputing environment.

FIG. 1 is a diagram of an exemplary architecture of a computing system100, consistent with disclosed embodiments. In FIG. 1, system 100includes a network 130 that interconnects a first device 102, a seconddevice 112, and a server 122. First device 102 and second device 112 maybe unrelated devices, and system 100 may provide functionality thatallows a user of first device 102 to interact with and control unrelatedsecond device 112 across network 130 using server 122. Although a firstdevice, a second device, and a single server are depicted in FIG. 1,system 100 may include any additional or alternate number of servers andunrelated devices. Furthermore, one or more of the components of system100 may be combined and/or divided into subcomponents.

First device 102 may include, but is not limited to, a mobile telephone,a smart phone, a voice-over-IP (VoIP) telephone, a personal digitalassistance having wireless communication capability, a video gamecontroller, a tablet personal computer (PC), a notebook computer, alaptop computer, or any additional or alternate device operable totransmit and receive data across network 130. Second device 112 mayinclude devices similar to those discussed above regarding first device102. Additionally, second device 112 may include, but is not limited to,a home security system, a household appliance (e.g., a lighting systemor a garage door opener), an electronic thermostat, a display device(e.g., a flat screen television, a LCD television, a plasma television,a projection-screen television, or a projection system), a set-top box,a digital video recorder (DVR), a web-enabled media player (e.g., a DVDplayer), a vehicle anti-theft system, an automatic vehicle ignitionsystem, an electronic vending machine 120, and any additional oralternate device capable of transmitting data across network 130.

First device 102 may include a processor 104, a memory 106, and anetwork interface 108 for communicating via network 130. Second device112 may also include a processor 114, a memory 116, and a networkinterface 118 for communicating via network 130. Processors 104 and 114may be configured to execute instructions and to process data to performone or more functions associated with system 100, such as one or more ofthe methods described below.

Memories 106 and 116 may include one or more memory devices that storedata, including, but not limited to, random access memory (RAM),read-only memory (ROM), a magnetic storage device (e.g., a hard disk),an optical storage medium (e.g., a CD- or DVD-ROM), a high-definitionoptical storage medium, an electronic storage device (e.g., EPROM or aflash drive), and/or another other data storage devices known in theart. Memories 106 and 116 may also store operating systems, such as DOS,Windows, or Linux, and may also include one or more applicationprograms, such as word processing, database programs, spreadsheetprograms, presentation programs, and graphics programs, and/or otherprograms capable of generating documents or other electronic content.Furthermore, memories 106 and 116 may include browser applicationscapable of rendering standard Internet content, such as NetscapeNavigator, Microsoft Internet Explorer, and/or Mozilla Firefox.Application programs may be implemented using applets, plug-ins,modules, widgets, and/or any other software components.

Network interfaces 108 and 118 may include any communication device forsending and receiving data across network 130. For example, networkinterfaces 108 and 118 may include a modem, a transceiver, a networkcommunication card, a satellite dish, an antenna, or another networkadapter capable of transmitting and receiving data over network 130.

Network 130 may represent any form or medium of digital datacommunication. Examples of network 130 include a local area network(“LAN”), a wireless LAN, e.g., a “WiFi” network, a wireless MetropolitanArea Network (MAN) that connects multiple wireless LANs, and a wide areanetwork (“WAN”), e.g., the Internet, a private network, and an intranet.In the embodiments described herein, the Internet may include anypublicly-accessible network or networks interconnected via one or morecommunication protocols, including, but not limited to, hypertexttransfer protocol (HTTP) and transmission control protocol/internetprotocol (TCP/IP). Moreover, network 130 may also include one or moremobile device networks, such as a GSM network or a PCS network, thatallow mobile devices to send and receive data across network 130 viaapplicable communications protocols, including those described above.

Server 122 may include a general purpose computer (e.g., a personalcomputer, network computer, server, or mainframe computer) having one ormore processors that may be selectively activated or reconfigured by acomputer program. However, server 122 is not limited to such exemplaryconfigurations, and in additional embodiments, server 122 beincorporated as a node in a distributed network, and additionally oralternatively, as a networked server in a cloud computing environment.For example, server 122 may communicate via network 130 with one or moreadditional servers (not shown), which may enable server 122 todistribute processes for parallel execution by the other servers.

Server 122 may include a processor 124, a memory 126, and a networkinterface 128 that may include functionalities similar to correspondingcomponents of first device 102 and second device 112. Furthermore,memory 124 may also include a content store 126A and a device store126B.

Content store 126A may include application programs that are executableby processor 124, and with which users of unrelated devices (e.g., firstdevice 102 and second device 112) may interact. For example, theapplications of content store 126A may include, but are not limited toelectronic games (e.g., video or arcade games), file sharingapplications (e.g., application facilitating the distribution ofpersonal photos and images), social networking or micro-bloggingapplications (e.g., Facebook and Twitter), widgets and plug-insassociated with, for example, web-based television and video-on-demandapplications, and any additional or alternate application program,widget, or plug-in.

Content store 126A may also include electronic content that may beaccessed by, and delivered to, one or more of the unrelated devicesinteracting with network 130. For example, the electronic media mayinclude, but is not limited to, digital videos associated with moviesand television programs, digital music, podcasts, digital images, andany additional or alternate form of electronic content. Furthermore, inadditional to files associated with the electronic content, contentstore 126A may also include resource identifiers to electronic mediastored on additional devices associated with system 100. For example, aresource identifier may include a physical network address (e.g., anetwork address expressed using a networking addressing protocol of aphysical network) associated with a device storing electronic media.

Device store 126B may include information specific to the networkconnectivity and operational characteristics of one or more devicesassociated with network 130. For example, device store 126B may includea physical network address for each device associated with network 130.Furthermore, device store 126B may also include additional connectivityparameters associated with the devices of network 130, including, butnot limited to, a connection speed, authentication parameters, aconnection capability of the device (e.g., an ability to connect to a 3Gwireless network), or any additional or alternate parameters.

In additional embodiments, device store 126B may store informationidentifying the devices associated with network 130. For example, theidentifying information may include, but is not limited to, identifiersassociated with the devices (e.g., device names, device serial numbers,or device manufacturers), and identifiers associated with users of thedevices (e.g., a user name associated with a user of first device 102).

Device store 126B may also store information identifying one or morecapabilities of the devices operating within system 100, but not limitedto, a display resolution, a display size, a range of operatingparameters, or any additional or alternate information. For example,server 122 may use the display specific information to translateinstructions received from first device 102 (e.g., instructionsassociated with a movement of a finger along a touchpad) into acorresponding output presented to a user by second device 112.

In operation, server 122 may enable a user of first device 102 tointeract with server 122 over network 130 to exert control overunrelated second device 112. For example, the user of first device 102may interact with server 122 over network 130 using a widget, plug-in,or other application executing on first device 102 to schedule deliveryof content to an unrelated device (e.g., second device 112), incommunication with server 122 over network 130. The unrelated devicemay, for example, display the content to the user, eitherinstantaneously or at a specific time, or store the delivered contentfor later display.

Additionally or alternatively, the user of first device 102 may interactwith server 122 over network 130 through a widget, plug-in, or otherapplication executing on first device 102 to modify an operational stateof an unrelated device (e.g., second device 112) in communication withserver 122 over network 130. For example, the user may transmit aninstruction to server 122 that enables server 122 to activate,de-activate, or modify an operational state of unrelated second device112.

In additional embodiments, an output of an application program executingon server 122 may be transmitted to one or more unrelated devices withinnetwork 130 (e.g., first device 102 and/or second device 112), which maypresent the output to corresponding users. Users may interact with orexert control over the application through instructions transmitted bythe unrelated devices to server 122 across network 130.

FIG. 2 is a flow diagram of an exemplary routine 200 that facilitatesinteraction between a server and multiple, unrelated devices, consistentwith disclosed embodiments. As described above, system 100 providesfunctionality that enables a user of a first device (e.g., first device102) to interact with a server (e.g., server 122) to schedule deliveryof content to an additional, unrelated device (e.g., second device 112).Routine 200 provides further details describing how server 122 interactswith first device 102 to deliver content to these additional unrelateddevices over network 130.

In block 202, server 122 may establish a communications session withfirst device 102. For example, server 122 may attempt to establish thecommunications sessions with first device 102 using authenticationtechniques associated with any of the communications protocols outlinedabove, or using any additional or alternate protocol appropriate tocomponents of system 100.

Server 122 may also obtain device-specific and connection-specificinformation associated with first device 102 in block 202. For example,such connection-specific information may include, but is not limited to,network addresses, connection speeds, and connection capabilitiesassociated with first device 102. Furthermore, such device-specificinformation may include, but is not limited to, information identifyingthe devices, sizes of display screens of the devices, and resolutions ofdisplay screen of the devices. The device-specific andconnection-specific information obtained by server 122 during block 202may be stored in a database (e.g., device store 126B).

In block 204, server 122 may receive a request from first device 102 todeliver electronic content to a second, unrelated device (e.g., seconddevice 112) across network 130. The request may specify one or moreelements of electronic content, and may specify second device 112 towhich the electronic content is to be delivered. For example, theelectronic content and second device may be specified by the userthrough a plug-in or widget associated with server 122 and executed byfirst device 102, as described below in reference to FIGS. 3A and 3B.

The elements of electronic content may include, but are not limited to,digital videos associated with movies and television programs, digitalmusic, podcasts, digital images, and any additional or alternate form ofelectronic media apparent to one of skill in the art. Furthermore, asdescribed above, second device 112 may be unrelated to first device 102.

In block 206, server 122 may determine whether the specified elements ofelectronic content are accessible. For example, server 122 may extractidentifiers associated with the specified elements of electronic contentfrom the request, and may compare the identifiers against correspondinginformation included within content store 126A to determine whether theelements of electronic content are accessible to server 122 and,additionally or alternatively, to second device 112.

If it is determined in block 206 that the electronic content is notaccessible then server 122 may prompt a user of first device 102 toselect an additional element of electronic content in block 208. In suchan embodiment, server 122 may await receipt of a request specifying theadditional element of electronic content in block 204.

However, if it is determined in block 206 that the specified electroniccontent is accessible, server 122 may retrieve information associatedwith the specified electronic content in block 210. For example, server122 may retrieve the specified electronic content from a repository(e.g., content store 126A) associated with server 122. Additionally oralternatively, server 122 may retrieve an address to the specifiedelectronic content from data store 126A, and may, for example,subsequently retrieve the specified electronic content from another datarepository within system 100 across network 130.

In block 212, server 122 may determine an identity of the second device112. The identity of second device 112 may be retrieved from devicestore 126B. For example, the identity of second device 112 may have beenpreviously designated by the user during a setup process. Alternatively,server 122 may request the identity of the second device 112 using othermethods known in the art. Server 122 may then use the identity of thesecond device 112 to determine an appropriate command to send to seconddevice 112 in order to carry out the request to deliver content to thesecond device 112.

In block 214, server 122 may attempt to establish a communicationssession with second device 112 over network 130. If it is determined inblock 214 that a communication session cannot be established with thesecond device then server 122 may prompt the user of mobile device 106in block 216 to select an additional device to receive the specifiedelectronic content. In such an embodiment, server 122 may await arequest in block 204 that specifies the additional device.

However, if server 122 is able to establish a communications sessionwith second device 112 in block 214, server 122 may translate thereceived request into an instruction that is appropriate to the seconddevice in block 218. For example, the instruction may include thespecified electronic content, and server 122 may deliver the instructionand the specified content to second device 112 in block 220. Thespecified electronic content may be delivered to second device 112 in anencrypted format (e.g., using IPsec), or in any other format apparentappropriate to the specified electronic content. After delivery in block220, server 122 may transmit a confirmation of the delivery to firstdevice 102 over network 130 in block 222.

Alternatively, in additional embodiments, the instruction may include anaddress of the specified electronic content, and server 112 may deliverthe instruction and the address to second device 112, which maysubsequently retrieve the specified electronic content. Additionally oralternatively, server 112 may transmit the translated instruction to anadditional intermediate device (e.g., a data repository) to deliver thespecified electronic content according to the received request.

Although described in terms of a first device and an unrelated seconddevice, routine 200 is not limited to any specific number of unrelateddevices interacting with server 122. For example, server 122 mayestablish communication sessions in block 202 with any additional oralternate number of devices supportable by network 130.

In the embodiments outlined above, a user of a device (e.g., firstdevice 102), may interact with server 122 to request a delivery ofelectronic content to an unrelated device. In such embodiments, firstdevice 102 may execute a widget, plug-in, or application program thatenables the user of first device 102 to enter the request and transmitthe request to server 122, as described below in reference to FIGS. 3Aand 3B.

FIG. 3A illustrates an exemplary interface 300 that enables a user offirst device 102 (e.g., a mobile telephone, smart phone, or video gamecontroller) to schedule delivery of electronic content to an unrelatedsecond device. Interface 500 may be generated by a widget, plug-in, orother application program associated with a server (e.g., server 122),or an additional service, including, but not limited to, a web-basedtelevision service or and a video-on-demand service.

Interface 300 includes a region 302 that allows the user to select anelement of electronic content from a specified set, and a region 304that allows the user to enter, through an appropriate input device, auser-defined selection of electronic content. For example, in region302, the user may select electronic content, such as a broadcast newsprogram (e.g., “News”), a television program (e.g., “Cheers”), a movie(e.g., “Harry Potter”), or a video game (e.g., “Pac-Man”). In additionalembodiments, interface 300 may facilitate the user's selection of anyadditional or alternate item of electronic content, availablecontemporaneously or at a future time.

Interface 300 may further include a region 306 that allows a user toselect a second, unrelated device to receive the content delivered byserver 122. For example, the devices associated with region 306 may beunrelated to first device 102, and may include, but are not limited to aset-top box (e.g., “My Set-Top Box”), a laptop computer (e.g., “MyLaptop”), a digital video recorder (e.g., “My DVR”), and a video gameconsole (e.g., “My Video Game Console”). Information associated with thedevices listed in region 306 may be stored in device store 126B ofserver 122, as described above.

Interface 300 may also include a region 308 that enables entry of auser-defined selection of an alternate, unrelated device. For example,the user may enter into region 308, using an input device associatedwith first device 102, an identifier associated with any of the devicesdescribed above in reference to system 100.

Once the user has selected a device and an element of electronic contentto be delivered to the device, the user may activate a “Deliver” icon310 to deliver the selected electronic content to the selected device.The request may be transmitted to server 122 and server 122 may processthe received request to identify the selected electronic content and theselected device (e.g., from content store 126A and device store 126B,respectively) Server 122 may further deliver an instructioncorresponding to the selected content to the selected unrelated device,as outlined above in reference to routine 200.

As shown in FIG. 3A, the user may request delivery of the selectedelectronic content to the device immediately following activation of the“Deliver” icon. In additional embodiments, the interface may beconfigured to enable to user to specify a future time and date at whichthe selected electronic content will be delivered to the selectedunrelated device, as described below in reference to FIG. 3B.

FIG. 3B illustrates an exemplary interface 320 that enables a user of adevice (e.g., first device 102), to request delivery of electroniccontent to an unrelated device at a future time. As described above,interface 320 may be generated by a widget, plug-in, or otherapplication program associated with a server, e.g., server 122, or anadditional service, including, for example, a web-based televisionservice or a video-on-demand service.

Similar to interface 300 of FIG. 3A, interface 320 includes a region 322that allows the user to select an element of electronic content from aspecified set of electronic content, a region 324 that allows entry of auser-defined selection of electronic content, and a region 306 thatallows the user to select an unrelated device to receive the selectedcontent. However, in contrast to the embodiment of FIG. 3A, interface320 includes region 326 and 338 that enable the user to specify,respectively, a date and corresponding time on which the selectedcontent will be delivered to the selected device. For example, the usermay select the broadcast television program “Cheers” as a contentelement from region 322, and may select that “Cheers” be delivered tothe user's DVR in region 326. The user may also specify a date and acorresponding time at which the DVR may be schedule to record “Cheers”.

The user may subsequently activate a “Deliver” icon 332 to deliver theselected electronic content to the selected device at the specified timeand date. As outlined above in reference to FIG. 2, the request may betransmitted to server 122, and server 122 may process the receivedrequest to identify the selected electronic content and the selecteddevice, and may deliver an instruction corresponding to the selectedcontent the unrelated device at the specified date and time, e.g., usingroutine 200.

In the exemplary interface of FIG. 3B, the user may select a time and adate for delivery of selected electronic content to a device. However,interface 320 is not limited to such exemplary indicia of delivery and,in additional embodiments, interface 320 may incorporate any additionalor alternate fields that allow the user to specify a future delivery ofelectronic content. Furthermore, although the user has selected “My DVR”within region 326, in additional embodiments, the user may haveselected, within region 326, any additional or alternate unrelateddevice (e.g., the devices within region 306 of FIG. 3A), or may havespecified any additional or alternate device (e.g., within region 308 ofFIG. 3A) compatible with the components of system 100.

The embodiments outlined above in reference to FIGS. 2, 3A, and 3B allowa user of a first device (e.g., a smart phone, mobile telephone, videogame controller, or any additional or alternate device described above)to coordinate delivery of electronic content to a second, unrelateddevice (e.g., a set-top box, a DVR, a video game console, a mediaplayer, or any additional unrelated device described above). Inadditional embodiments, the user of the first device may interact withserver 122 to modify a state of an unrelated second device, as describedbelow regarding FIG. 4.

FIG. 4 is a flow diagram of an exemplary routine 400 that facilitatesinteraction between a server and multiple, unrelated devices, consistentwith disclosed embodiments. As described above, system 100 providesfunctionality that enables a user of first device 102 (e.g., firstdevice 102) to interact with a server (e.g., server 122) to modify anoperational state of a second, unrelated device (e.g., second device112). Routine 400 provides further details describing how first device102 interacts with server 122 to modify an operational state of seconddevice 102.

In block 402, server 122 may establish a communications session withfirst device 102. Server 122 may also obtain device-specific andconnection-specific information associated with first device 102 inblock 402. The device-specific and connection-specific informationobtained by server 122 during block 402 may be stored in a database(e.g., device store 126B).

In block 404, server 122 may receive a request from first device 102 tomodify an operational state of an unrelated second device (e.g., seconddevice 112) in communication with network 130. For example, theunrelated device may include, but is not limited to, a home securitysystem, one or more household appliances (e.g., a lighting system, agarage door opener, a coffee maker, or a dishwashing appliance), anelectronic thermostat, a vehicular anti-theft system, an automaticignition device for a vehicle, an electronic vending machine, aunrelated device similar to first device 102, and any additional oralternate device appropriate to the components of system 100.

The modification to the operational state may include, but is notlimited to, an activation of second device 112, an activation of one ormore functions of second device 112, a de-activation of second device112, or a de-activation of one or more functions of the modification tothe operational state may include, but is not limited to, an activationof second device 112, an activation of one or more functions of seconddevice 112, a de-activation of second device 112, or a de-activation ofone or more functions of second device 112. Furthermore, in suchembodiments, the request may also include a time, a date, or acombination thereof associated with the modification to the operationalstate of second device 112.

In block 406, server 122 may determine an identity of second device 112.The identity of second device 112 may be retrieved from device store126B. For example, the identity of second device 112 may have beenpreviously designated by the user during a setup process. Alternatively,server 122 may request the identity of the second device 112 using othermethods known in the art. Server 122 may then use the identity of thesecond device 112 to determine a set of appropriate instructions tomodify the operational state of second device 112 in accordance with therequest.

In block 408, server 122 may attempt to establish a communicationssession with second device 112 over network 130. If it is determined inblock 408 that a communication session cannot be established with seconddevice 112 then server 122 may transmit an error message to the user offirst device 102 in block 410 across network 130. Furthermore, in anadditional embodiment (not shown), server 122 may prompt the user tospecify a modification to an additional, unrelated device, and may awaita corresponding request in block 404 that specifies the modification.

However, if server 122 is able to establish a communications sessionwith second device 112 in block 408, server 122 may translate thereceived request into an instruction appropriate to the second device inblock 412, and may transmit the instruction to second device 112 inblock 414 to modify the operational state of second device 112 inaccordance with the request. After transmission of the instruction,server 122 may transmit a confirmation of the transmission to the userof first device 102 over network 130 in block 416.

In the embodiments outlined above, a user of a first device (e.g., firstdevice 102), may interact with server 122 to request to modify anoperational state of an unrelated, second device (e.g., second device112). In such embodiments, first device 102 may execute a widget,plug-in, or application program that enables the user of first device102 to enter the request and transmit the request to server 122, asdescribed below regarding FIGS. 5A-5D.

FIGS. 5A and 5B illustrate exemplary interfaces that enable a user of adevice (e.g., first device 102), to modify an operational state of anunrelated second device (e.g., a home security system, a householdappliance, or an electronic thermostat) associated with a user. Theexemplary interfaces of FIGS. 5A and 5B may be generated by a widget,plug-in, or other application program associated with a server (e.g.,server 122) or an additional service, including, but not limited to, aprovider of the home security system, the appliance, or the thermostat.

In FIG. 5A, an exemplary interface 500 includes a region 502 that allowsthe user to select a second, unrelated device from a specified set ofdevices, and a region 504 that allows the user to enter, through anappropriate input device, a user-defined selection of an unrelateddevice. For example, in region 502, the user may select, as theunrelated device, a home security system, a lighting system, a householdappliance, such a device for opening a garage door, a DVR (e.g., “MyDVR”), or a set top box (e.g., “My Set Top Box”). Interface 500 may alsofacilitate the user's selection of any additional or alternate unrelateddevices compatible with the components of network 130.

Interface 500 further includes a region 506 that allows the user toselect a particular change in the operational state of the unrelateddevice specified by the user in one of region 502 and 504. For example,in region 506, the user may choose to “activate” the unrelated device,or alternatively, to “de-activate” the unrelated device. However,interface 500 is not limited to such exemplary changes of operationalstate, and in additional embodiments (not shown), the user may select inregion 506 to activate one or more particular functions of the unrelateddevice or, alternatively, to deactivate one or more particular functionsof the selected device.

Interface 500 may also include a region 508 that enables the user tospecify that the requested change in state affects the unrelated deviceimmediately. Alternatively, the user may enter within region 510 aspecific time in the future at which the selected change in state willbe effective.

Once the user has selected the unrelated device, the change in state,and the effective time, the user may activate a “Deliver” icon 512 totransmit the request to server 122. As described above in reference toFIG. 4, server 122 may identify the selected device, the selected changein state, and the effective time from the request, and may generate acorresponding instruction to the unrelated device that modifies thestate of the unrelated device in accordance with the request.

FIG. 5B illustrates an exemplary interface 520 that enables a user of adevice (e.g., first device 102), to modify an operational state of anelectronic thermostat associated with a heating and cooling apparatus ofthe user's home, office, or other space. In such an embodiment,interface 520 may include a region 522 that enables to user to selectthe electronic thermostat as the unrelated device, and a region 524 thatenables the user to select a state change appropriate to the electronicthermostat.

For example, in region 524, the user may select to change an operationalsetting of the electronic thermostat to heat the space (i.e., byselecting “Heat”), or alternatively, to cool the space (i.e., byselecting a fan associated with the heating and cooling apparatus (i.e.,by selecting “Fan”), or the user may alternatively deactivate theheating and cooling apparatus by turning off the thermostat (i.e., byselecting “Off”).

Depending on the selected change in operational mode, interface 520 mayalso include region 526 that enables a user to enter a thresholdtemperature using an input device associated with first device 102. Forexample, the threshold temperature represents a temperature at which theheating and cooling apparatus maintains the home when the electronicthermostat is in either “heat” or “cool” mode.

Once the user has selected the electronic thermostat, specified thedesired state change, and entered the threshold temperature, the usermay activate a “Deliver” icon 512 to transmit the request to server 122.As described above in reference to FIG. 6, server 122 may identify theselected state change and the threshold temperature from the request,and may generate a corresponding instruction to modify the state of theelectronic thermostat in accordance with the request.

FIG. 5C illustrates an exemplary interface 540 that enables a user of afirst device 102 to modify an operational state of an unrelated seconddevice associated with a vehicle of the user, e.g., an anti-theft systemor an automatic ignition system. As discussed above, exemplary interface540 may be generated by a widget, plug-in, or other application programassociated with server 122, or an additional service, including, but notlimited to, a provider of the anti-theft system or the automaticignition system.

In FIG. 5C, interface 540 includes a region 542 that allows the user toselect a second, unrelated device from a specified set of devices, and aregion 544 that allows the user to enter, through an appropriate inputdevice, a user-defined selection of an unrelated device. For example, inregion 542, the user may select, as the unrelated device, a vehicleanti-theft system or an automatic ignition system.

Interface 540 further includes a region 546 that allows the user toselect a change in the operation state of the unrelated device selectedby the user in one of region 542 and 544. For example, in region 546,the user may choose to “activate” the unrelated device, oralternatively, to “de-activate” the unrelated device. However, interface500 is not limited to such exemplary changes of operation state, and inadditional embodiments (not shown), the user may select in region 546 toactivate one or more particular functions of the unrelated device, oralternatively, to deactivate one or more particular functions of theunrelated device.

Interface 540 may also include a region 548 that enables the user tospecify that the requested change in state affects the unrelated deviceimmediately. Alternatively, the user may enter within region 550 aspecific time in the future at which the selected change in state willbe effective.

The user may subsequently activate a “Deliver” icon 552 to transmit therequest to server 122. As described above in reference to FIG. 4, server122 may identify the selected device, the selected change in state, andthe effective time from the request, and may generate a correspondinginstruction to modify the state of the unrelated device in accordancewith the request.

In another embodiment, interfaces may enable a user to purchase itemsfrom a vending machine, as described below in reference to FIG. 50. Forexample, vending machines may include, but are not limited to, snackmachines, soda machines, DVD rental stations, or any additional oralternate vending machine.

FIG. 5D illustrates an exemplary interface 560 that enables a user offirst device 102 to purchase an item from an electronic vending machine.As discussed above, exemplary interface 560 may be generated by awidget, plug-in, or other application program executed by first device102 and associated with a server (e.g., server 122), or an additionalservice, including, but not limited to, a provider of the vendingmachine.

Interface 560 may include a region 562 that enables to user to selectone of a number of vending machines available to the user. First device102 may be associated with a geo-spatial positioning system (e.g., a GPSsystem) that identifies a location of first device 102, and the widget,plug-in, or application executing on first device 102 may leverage thelocation to present one or more vending machines in region 562 that areproximate to the user's location. For example, interface 560 mayidentify that the user is near a snack vending machine and a DVD vendingmachine, and may enable to user to select one of the identified machinesin region 562.

After selection of a vending machine in region 562 (e.g., the snackvending machine), interface 560 may display one more items available forpurchase from the selected vending machine within region 564. Forexample, in FIG. 5D, region 564 indicates that “soda,” “juice,” “chips,”and “pretzels” are available for purchase from the snack vending machineidentified in region 562. The user may select one or more of the itemsidentified within region 564 for purchase.

Once the user has selected one or more items for purchase, the user mayactivate a “Deliver” icon 512 to transmit the request for the items toserver 122. As described above in reference to FIG. 4, server 122 mayextract identifiers of the selected vending machine and the item fromthe request, and may execute the purchase from the vending machine inaccordance with the received request. In such embodiments, widget,plug-in, or application executing on mobile device 106 may be associatedwith a financial account of the user (e.g., a checking account of theuser or a credit card of the user), and server 122 may interface withthe selected vending machine to complete the transaction using thefinancial account of the user.

FIG. 6 is a flow diagram of an exemplary routine 600 that facilitatesinteractions between multiple, unrelated devices and a server,consistent with disclosed embodiments. As described above, system 100provides functionality that enables a user associated with a firstdevice (e.g., first device 102) to interact with or control contentpresented by a second device (e.g., second device 112), and to interactwith multiple users of similar unrelated first and second devices.Routine 600 provides further details describing how a user of firstdevice 102 interacts with and controls content displayed by unrelatedsecond device 112, and interacts with multiple, geographically dispersedusers.

Although described in terms of a single control device and a singledisplay device, exemplary routine 600 is not limited to a specificnumber of devices interacting with server 122. In additionalembodiments, server 122 may establish communication sessions with anyadditional or alternate number of devices supportable by network 130 andassociated with multiple users within system 100.

In block 602, server 122 may establish a communications session withfirst device 102 (e.g., a smart phone, a mobile phone, a video-gamecontroller, etc.), and may establish a communications sessions withsecond device 112 (e.g., a set top box, a DVR, and a web-enabled DVDplayer, etc.). Second device 112 may be in communication with a displaydevice (e.g., a high-definition television, an LCD television, a plasmatelevision, or a three-dimensional television).

First device 102 and a display device associated with second device 112may present electronic content to the user. For example, the electroniccontent may include broadcast television programs, DVD programs,additional content associated with a video-on-demand service, aweb-based television application, or any additional or alternate contentcompatible with the components of system 100.

In block 604, server 122 may translate an output of an applicationexecuting on server 122 into a format compatible with second device 112,and server 122 may transmit the translated output of the application tosecond device 112 in block 606. For example, the translated output ofthe executed application may include a video stream, an audio stream,one or more discrete video files or audio files, one or more digitalimages, and a string of characters. Furthermore, for example, seconddevice 112 may receive the output, render, in conjunction with thedisplay device, the received output for presentation, and subsequentlypresent the rendered output to one or more viewers. The output may bepresented to the user concurrently with the content presented to theuser by the display device. For example, the transmitted output mayoverlap a portion of the presented content, or may be presented to theuser within a window proximate to the displayed content.

In an additional embodiment, in block 604, server 122 may also translatethe output into a format compatible with first device 102, and maydeliver the translated output to first device 102 in block 606substantially in parallel with the transmission of the output to seconddevice 112. First device 102 may receive the output from server 122,render the received output for presentation, and present the renderedoutput to the user of first device 102. For example, the outputpresented by first device 102 may include information similar to theoutput transmitted to second device 112, and as described above, thetransmitted output may be presented concurrently with electronic contentpresented to the user by first device 102.

The application may correspond to an application program or set ofprogram instructions accessible to server 122 (e.g., stored withincontent store 126A). As described above, the application may include anelectronic game (e.g., video or arcade games), a file sharingapplication (e.g., application facilitating the distribution of personalphotos and images), a social networking or micro-blogging application(e.g., Facebook or Twitter), and any additional or alternate applicationprogram.

In an additional embodiment, the application may include an interactivegaming application that allows multiple, geographically-dispersed usersof unrelated devices within system 100 to interact with each other inresponse to the displayed content (e.g., content displayed on a displaydevice in communication with second device 112). For example, server 122may transmit a question associated with the presented content to one ormore of first device 102 and second device 112 in block 604, and tosimilar devices associated with multiple users within system 100, toenable interaction between users viewing a common element of electroniccontent (e.g., a television program or a movie).

In additional embodiments, the output transmitted to first device 102may prompt the user of first device 112 to select an item of theelectronic content, and to deliver additional electronic contentassociated with the selection to an unrelated device (e.g., using aninterface similar to interface 300 of FIG. 3). For example, a user may“tag” electronic content and deliver additional electronic associatedwith the tagged content to an unrelated device.

Referring back to FIG. 6, in block 608, server 122 may receive aresponse to the transmitted output from first device 102. For example,the response may include an instruction to modify a state of theapplication executing on server 122, an answer to the output of theinteractive question posed to the user, or a selection of the contentpresented to the user (e.g., “tagged” content). The instruction mayinclude data generated based on a user command received through aninterface of first device 102, including, for example, a string ofcharacters entered into first device 102 using a keyboard ortouch-screen interface, a selection of an icon displayed on first device102 using a mouse, touchpad, or other appropriate interface, a gesturalinput associated with a movement of a mouse, a movement associated witha touchpad, or a movement associated with any other appropriateinterface.

In block 610, server 122 may determine whether the response to thetransmitted output corresponds to a request for additional contentassociated with a selection of content to the user of first device 112content. If it is determined in block 610 that the response does notcorrespond to a request for additional content, then server 122 maymodify a state of the application executing on server 122 according tothe received response in block 612 (e.g., as described above inreference to FIG. 4).

The modification may reflect a desired motion of a character or avatarin an electronic game, a selection of electronic content displayed in afile sharing application, or any additional or alternate modification toan application state appropriate to the application. In an additionalimplementation, the modification in block 610 may include a collectionof responses from multiple users to the output of an interactivequestion, a determination of a correct response, and an identificationof those users submitting the correct response.

In response to the modification, server 122 may generate additionaloutput, including, for example, an audio stream, one or more discretevideo files or audio files one or more digital images, and a string ofcharacters. In block 614, server 122 may transmit the additional outputto one or more of first device 102 and second device 112, and to similarunrelated devices associated with multiple users within system 100. Insuch embodiments, first device 102 and second device 112, and theadditional unrelated devices, may present the additional output to oneor more viewers.

However, if it is determined in block 610 that the response to thetransmitted output includes a request to deliver additional content toan unrelated device, server 122 may identify the additional contentrelated and the unrelated device in block 616. Server 122 may extract anidentifier associated with selected electronic content included withinthe request, and retrieve additional content associated with theselection, for example, from content store 126A or from additional datarepositories included within system 100. The additional content mayinclude digital video files, digital audio files, digital images,text-based documents, advertisements, or any additional or alternatecontent appropriate to the components of system 100.

In block 616, server 122 may also extract an identifier associated withthe unrelated device, and obtain device-related information, including aphysical network address of the unrelated device, from device store126B. In block 618 the retrieved additional content may be transmittedacross network 130 to the unrelated device associated with the receivedrequest.

In the embodiments of FIG. 6, a user may interact with a server acrossnetwork 130 using multiple, unrelated devices (e.g., first device 102and second device 112). As such, and in contrast to conventionalPC-based systems, system 100 may represent a “virtual personal computer”that allows the user to leverage the functionality of network-based, or“cloud-based,” resources using a control device and a display deviceselected by the user.

For example, the disclosed embodiments may enable a user of a device(e.g., first device 102), to “tag” electronic content and deliveradditional electronic associated with the tagged content to unrelatedsecond device 102. As discussed above, output transmitted to firstdevice 102 in block 606 may prompt the user of first device 102 toselect an item of the electronic content, and to deliver additionalelectronic content associated with the selection to an unrelated device,as disclosed below regarding FIGS. 7A and 7B.

FIG. 7A illustrate an exemplary interface 700 that enables a user offirst device 102 to tag a selection of displayed electronic, accordingto disclosed embodiments. Interface 700 may be generated by a widget,plug-in, or other application program associated with a server (e.g.,server 122) or an additional service, including, but not limited to aweb-based television service or and a video-on-demand service.

Interface 700 displays to the user an element 702 of electronic content.Element 702 may represent a portion of a video stream transmitted tofirst device 102 from, for example, web-based television service or avideo-on-demand service, a digital image within a file sharingapplication or any additional or alternate content.

For example, in FIG. 7A, the user of first device 102 may be viewing abaseball game involving a local team, and element 702 may a batter ofthe team approaching the plate. Although the example of a baseball gameis discussed in connection with FIG. 7A, in other embodiments, element702 may include additional or alternate content displayable to the userby first device 102.

Interface 700 may enable the user to select content element 702 (e.g.,the batter) using, for example, an input device of first device 102. Insuch embodiments, server 122 may transmit data regarding one or moreelements of content displayed to the user, and the widget, plug-in, orother application program may leverage this information to enable touser to select an element of displayed content and obtain additionalinformation associated with the selected content element from server122.

Interface 700 may display an output that prompts the user in region 704to “Click on Content of Interest.” The user of the first device 102 mayselect the content of interest (e.g., the batter associated with contentelement 702), by clicking or otherwise selecting the content using atouch-screen interface or a roller-ball interface, according to a stringof characters entered into first device 102 using a keyboard ortouch-screen interface, and or using any additional or alternate meansappropriate to first device 102.

Once element 702 is selected by the user, first device 102 may transmitthe selected content element to server 122 as a request for additionalcontent. After receipt of the request, server 122 may extract anidentifier associated with selected content and may identify one or moreelements of additional electronic content associated with the selection.For example, the additional content elements may be extracted fromcontent store 126B of server 122, or may be obtained from one or moredata repositories in communication with server 122 across network 130.

After identification of the additional content elements, server 122 maytransmit identifiers associated with the additional content to firstdevice 102, and the widget, plug-in, or other application may enable theuser to select one or more of the identified content for delivery to anunrelated device using interface 720 of FIG. 7B.

In FIG. 7B, interface 720 includes a region 722 that allows the user toselect elements of additional electronic content from a specified set ofelectronic content. For example, in region 722, the user may select, aselectronic content associated with selected content 702, scoresassociated with the local team (e.g., “Local Scores”), streaming videoassociated with the selected content (e.g., “Streaming Games), andinformation regarding tickets associated with sporting events associatedwith the selected content (e.g., “Ticket Information”). In additionalembodiments, interface 720 may facilitate the user's selection of anyadditional or alternate item of electronic content, availablecontemporaneously or at a future time.

Interface 720 may include a region 724 that allows a user to select asecond, unrelated device to which the selected content is delivered byserver 122. The devices associated with region 724 may be unrelated tofirst device 102, and may include, but are not limited to a set-top box(e.g., “My Set-Top Box”), a laptop computer (e.g., “My Laptop”), adigital video recorder (e.g., “My DVR”), and a smart phone (e.g., “MySmart Phone”). Information associated with the devices listed in region724 may be stored in device store 126B of server 122 as described above.

Although not depicted in FIG. 7B, interface 720 may also include aregion that enables entry of a user-defined selection of additionalcontent, and a region that enables entry of a user-defined selection ofan alternate, unrelated device. For example, the user may enter intosuch regions, using an input device associated with first device 102 anidentifier associated with additional elements of electronic content, oran identifier associated with any of the devices described above.

Once the user has selected an unrelated device and an element ofelectronic content to be delivered to the unrelated device, the user mayactivate a “Deliver” icon 726 to deliver the selected electronic contentto the selected device. In such an embodiment, the request may betransmitted to server 122. Server 122 may process the received requestto identify the selected electronic content and the selected device(e.g., from content store 126A and device store 126B, respectively), andmay deliver an instruction corresponding to the selected content to theselected unrelated device, as outlined above.

Routine 600 of FIG. 6 may also enable one or moregeographically-dispersed users to interact with server 122 over network130 to participate in an electronic gaming application (e.g., a PC-basedvideo game or an interactive quiz game) using corresponding, unrelatedcontrol and display devices. For example, each of the one or moregeographically-dispersed users may be associated with corresponding,unrelated control and display devices that enable the users to viewaudio-visual content and to interact with each other through aninteractive quiz game, as described below in FIGS. 8 and 9A-9C.

FIG. 8 illustrates an exemplary configuration of system 100 thatincludes unrelated control and display devices ofgeographically-dispersed users in communication with server 122 acrossnetwork 130, consistent with disclosed embodiments. In FIG. 8, a firstuser 800A may be associated with a control device 802, a set top box804, and a display device 806 in communication with set-top box 804. Asecond user 800B may be associated with a control device 812, a set topbox 814, and a display device 816 in communication with set top box 814.First user 800A may be associated with a geographic location differentfrom a geographic location of second user 800B. For example, the firstuser 800A and second user 800B may be position in different rooms of adormitory, or first user 800A may be located, for example, inWashington, D.C., while second user 800B may be located, for example, inSeattle, Wash. Accordingly, electronic content (e.g., streaming video,digital images, audio, etc.) may be presented to first user 800A andsecond user through corresponding set-top boxes and display devices, andfirst user 800A may interact with second user 800B across network 130using an interactive quiz game associated with the streaming video andcoordinated by server 122.

As discussed above, control device 802 may be unrelated to set top box804 and display device 806, and control device 812 may be unrelated toset top box 814 and display device 816. For example, control devices 802and 812 may include one or more of a mobile telephone, a smart phone, anvoice-over-IP (VoIP) telephone, a personal digital assistance havingwireless communication capability, a video game controller, a tabletpersonal computer (PC), a notebook computer, a laptop computer, or anyadditional or alternate device operable to transmit and receive dataacross network 130.

As discussed above, display devices 806 and 816 may include,respectively, a high-definition television, a LCD television, a plasmatelevision, a projection display, or any additional or alternate displaydevice apparent to one of skill in the art and capable of communicationwith corresponding set top boxes 804 and 814. Although described interms of set top boxes, devices 804 and 814 are not limited to suchexemplary devices, and in additional embodiments, devices 804 and 814may include web-enables DVD or Blu-ray players, DVRs, or any additionalor alternate devices enabled to communicate with server 122 over network130.

FIGS. 9A, 9B, and 9C depict exemplary content associated with aninteractive quiz game executed by server 122, according to disclosedembodiments. As outlined above, first user 800A may be viewingaudio-visual content presented by display device 806 in communicationwith set-top box 804, and second user 800B may be viewing audio-visualcontent presented by display device 816 in communication with set-topbox 814.

At a pre-determined time during the presentation of the audio content,or in response to a triggering event (e.g., a request to initiate theapplication from one or more of first user 800A and second user 800B),server 122 may transmit an output of the interactive quiz game toset-top boxes 804 and 814, and display devices 806 and 816 may presentthe received output to first user 800A and second user 800B.

FIG. 9A illustrates an exemplary output 900 of an interactive quiz gametransmitted from server 122 to set-top boxes 804 and 814, and presentedto the first user 800A and second user 800B by display devices 806 and816. In FIG. 9A, output 900 presented to first user 800A and second user800B includes a question 902 associated with an element of theaudio-visual content the first user. For example, question 902 may askfirst user 800A and second user 800B, “What is the hometown of the maincharacter?” In additional embodiments, question 902 may include anyadditional or alternate question associated with the presentedaudio-visual content.

Substantially in parallel with the transmission of output 900 to set topboxes 804 and 814, server 122 may also transmit a similar output tocontrol devices 802 and 812. FIG. 9B illustrates an exemplary output 920that may be transmitted to control devices 802 and 812.

In FIG. 9B, output 920 may present question 902 to a user (e.g., firstuser 800A and second user 800B), and may further present an input region904 that allows the user to enter an answer to question 902. The usermay enter a response to question 902 within region 924 using interfacesassociated with control devices 802 and 804, including, but not limitedto a keyboard, mouse, touch pad or touch screen, microphone, videocamera, or any additional or alternate interface appropriate to controldevices 802 and 804.

Once first user 800A and second user 800B enter the answer to question902 within region 824 of their respective control devices, the controldevices may transmit the submitted answers to server 122 as aninstruction. Furthermore control devices 802 and 812 may alsoincorporate into the instructions an identifier of the correspondingcontrol device (e.g., a device name, a serial number of the device, or amanufacturer of the device) and/or an identifier of the correspondinguser (e.g., a user name of first user 800A or second user 800B).

Server 122 may receive the instructions from control device 802 of firstuser 800A, from control device 812 of second user 800B, and from controldevices associated with others of the multiple viewers (e.g., withinblock 606 of FIG. 6). Server 122 may process the received instructionsto extract the answers associated with the questions, and maysubsequently determine whether any of the extracted answers match acorrect answer, and additionally or alternatively, any portion of thecorrect answer deemed to be a correct answer (e.g., within block 610 ofFIG. 6). Server 122 may subsequently transmit an output associated withthe correct answer to question 902 to set-top boxes 804 and 814, andadditionally or alternatively, to the control devices 802 and 812 (e.g.,within block 612 of FIG. 6).

FIG. 9C illustrates an exemplary output 940 associated with a correctanswer that is transmitted from server 122 to set top boxes 804 and 814,and displayed to first user 800A and second user 800B by correspondingdisplay devices 806 and 816. In FIG. 9C, output 940 includes a correctanswer 946 and information 948 identifying those users associated withcorrect answers. For example, correct answer 906 is “Washington, D.C.,”and information 948 lists “User#1” as submitting the correct answer.

In the implementation discussed above regarding FIGS. 8 and 9A-9C, adisplay device (e.g., display device 806) is in communication with a settop box (e.g., set top box 804) and displays content received andrendered by the set top box. In additional embodiments, the displaydevice may include functionality to establish a connection with a moduleof server 122 configured to transmit media content (e.g., Flash media)across network 130. Once such a connection is established andperiodically synchronized, the display device may receive outputtransmitted from server 122, render that output into a format forpresentation, and present the rendered output to one or more viewers,without any intermediate set-top box, DVR, or web-enabled DVD or Blu-rayplayer.

In the embodiments described above, server 122 receives and executesfunctions (e.g., delivering content and modifying device states) inresponse to instruction received from, for example, unrelated firstdevice 102 and second device 112. In additional embodiments, suchfunctions may be executed by server 122 absent any specific instructionfrom first device 102 and second device 112. For example, server 122 mayperform these functions in response to a particular triggering event,e.g., in response to a particular action of the user, in response to aparticular time stamp, or in response to any additional or alternateevent or user action.

Furthermore, in the exemplary routines of FIGS. 2, 4, and 6, firstdevice 102 and second device 112 may transmit an instruction to server122 that includes, for example, a string of characters entered intomobile device 106 using a keyboard or touch-screen interface, and aselection of an icon displayed on mobile device 106 using a mouse,touchpad, or other appropriate interface. However, the instructions arenot limited to such exemplary data, and in additional embodiments, theinstructions transmitted from first device 102 and second device 112 toserver 122 may include a physical gesture of the user of mobile device106.

In such an embodiment, server 122 may receive the instruction thatincludes the physical gesture of the user, and may detect the gesture ofthe user from the instruction. For example, the control instruction mayincorporate a digital image that includes the gesture, and server 122may extract the gesture from the digital image using one or more digitalimage processing techniques.

Once the gesture of the user has been detected from the controlinstruction, server 122 may correlate the detected gesture with anintended action (e.g., a delivery of content or a modification of astate of a device). The correlation may be based on a comparison betweenthe detected gesture and a database or repository of stored gestures andmodifications associated with the stored gestures (e.g., stored inmemory 126 of server 122). For example, the server may process thereceived instruction to identify a “sweeping” motion of the user's hand,and may correlate the “sweeping” motion with an intended modification ofa state of a device. Such intended modifications may include, but arenot limited to, activating or deactivating a device, selecting orbrowsing electronic content displayed in a file management application,modifying a volume at which an output of an application program ispresented by the device, or any additional or alternate modification oraction.

As one of ordinary skill in the art will appreciate, one or more ofblocks 202-222, 402-416, and 602-618 may be optional and may be omittedfrom implementations in certain embodiments. Furthermore, functionalityprovided by one or more of blocks 202-222, 402-416, and 602-618 may besubdivided into multiple blocks.

The foregoing description has been presented for purposes ofillustration. It is not exhaustive and is not limiting to the preciseforms or embodiments disclosed. Modifications and adaptations will beapparent to those skilled in the art from consideration of thespecification and practice of the disclosed embodiments. For example,the described implementations include software, but systems and methodsconsistent with the disclosed embodiments be implemented as acombination of hardware and software or in hardware alone. Examples ofhardware include computing or processing systems, including personalcomputers, servers, laptops, mainframes, micro-processors and the like.Additionally, although aspects of the disclosed embodiments aredescribed as being stored in memory, one skilled in the art willappreciate that these aspects can also be stored on other types ofcomputer-readable media, such as secondary storage devices, for example,hard disks, floppy disks, or CD-ROM, or other forms of RAM or ROM, USBmedia, DVD, or other high-definition optical storage media.

Computer programs based on the written description and disclosed methodsare within the skill of an experienced developer. The various programsor program modules can be created using any of the techniques known toone skilled in the art or can be designed in connection with existingsoftware. For example, program sections or program modules can bedesigned in or by means of .Net Framework, Net Compact Framework (andrelated languages, such as Visual Basic, C#, etc.), Java, C++,Objective-C, HTML, HTML/AJAX combinations, XML, or HTML with includedJava applets. One or more of such software sections or modules can beintegrated into a computer system or existing e-mail or browsersoftware.

Moreover, while illustrative embodiments have been described herein, thescope of any and all embodiments having equivalent elements,modifications, omissions, combinations (e.g., of aspects across variousembodiments), adaptations and/or alterations as would be appreciated bythose in the art based on the present disclosure. The limitations in theclaims are to be interpreted broadly based on the language employed inthe claims and not limited to examples described in the presentspecification or during the prosecution of the application, whichexamples are to be construed as non-exclusive. Further, the blocks ofthe disclosed routine s may be modified in any manner, including byreordering blocks and/or inserting additional blocks or deleting blocks.It is intended, therefore, that the specification and examples beconsidered as exemplary only, with a true scope and spirit beingindicated by the following claims and their full scope of equivalents.

What is claimed is:
 1. A computer-implemented method comprising:establishing a communications session between a networked server and acontrol device of a user; establishing a communications session betweenthe networked server and a controlled device, wherein the control deviceis not included with the controlled device; transmitting, to the controldevice, a digital content item and data regarding a plurality of contentelements within the digital content item; receiving, at the networkedserver, a selection of a selected content element of the plurality ofcontent elements, wherein the selected content element is selectedduring presentation of the digital content item at the control device;identifying one or more additional content items related to the selectedcontent element; transmitting, to the control device, data regarding theone or more additional content items related to the selected contentelement; subsequent to transmitting the data regarding the one or moreadditional content items related to the selected content element,receiving, at the networked server, a first instruction from the controldevice, the first instruction regarding an additional content item ofthe one or more additional content items; determining, at the networkedserver, a second instruction being operable to cause the controlleddevice to obtain the additional content item at a time or dateconsistent with the second instruction; and transmitting the secondinstruction to the controlled device.
 2. The computer-implemented methodof claim 1, wherein: the first instruction comprises a request toretrieve the additional content item, the additional content item beingassociated with an identifier; and the second instruction is operable tocause the controlled device to retrieve the additional content itembased on at least the identifier.
 3. The computer-implemented method ofclaim 1, wherein the controlled device is a first controlled device, andthe second instruction is sent to the first controlled device and asecond controlled device, wherein the control device is not includedwith the second controlled device.
 4. The computer-implemented method ofclaim 1, wherein the control device of the user is a first controldevice, wherein the first control device and a second control device areenabled to control the controlled device, and wherein the second controldevice is not included with the controlled device.
 5. Thecomputer-implemented method of claim 1, wherein: the first instructioncomprises a request to associate an identifier with the digital contentitem; and the second instruction is operable to cause the controlleddevice to associate the identifier with the digital content item.
 6. Thecomputer-implemented method of claim 5, wherein the identifier isfurther associated with the additional content item, and the secondinstruction is further operable to cause the controlled device toretrieve the additional content item based on at least the identifier.7. A computer-implemented method comprising: transmitting, to a controldevice of a user, a digital content item and data regarding one or morecontent elements within the digital content item; receiving, at anetworked server, a selection of a first content element of the one ormore content elements, wherein the first content element is selectedduring presentation of the digital content item at the control device;transmitting, to the control device, data regarding one or moreadditional content items associated with the first content element;subsequent to transmitting the data regarding the one or more additionalcontent items associated with the first content element, receiving, atthe networked server, a first instruction from the control device, thefirst instruction regarding obtaining, by a controlled device, anadditional content item of the one or more additional content items,wherein the control device is not included with the controlled device;generating, at the networked server, a second instruction being operableto cause the controlled device to obtain the additional content itemconsistent with the second instruction; and transmitting the secondinstruction to the controlled device.
 8. The computer-implemented methodof claim 7, further comprising: establishing a communications sessionbetween the networked server and the control device; and establishing acommunications session between the networked server and the controlleddevice.
 9. The computer-implemented method of claim 7, wherein: thefirst instruction comprises a request to retrieve the additional contentitem, the additional content item being associated with an identifier;and the second instruction is operable to cause the controlled device toretrieve the additional content item based on at least the identifier.10. The computer-implemented method of claim 9, wherein the request toretrieve the additional content item comprises a retrieval time or aretrieval date.
 11. The computer-implemented method of claim 9, whereinthe first instruction further comprises a request to associate theidentifier with the digital content item, and wherein the secondinstruction is further operable to cause the controlled device toassociate the identifier with the digital content item.
 12. Thecomputer-implemented method of claim 9, further comprising: processingthe first content element to identify the one or more additional contentitems related the first content element; retrieving, from a storagedevice, the one or more additional content items; transmitting the oneor more additional content items to the control device, wherein thecontrol device is configured to present the one or more additionalcontent items to a user; and receiving, from the control device, aselection of the additional content item.
 13. The computer-implementedmethod of claim 9, wherein the first instruction comprises datagenerated based on at least a user command received through an interfaceof the control device.
 14. The computer-implemented method of claim 9,wherein the first instruction further comprises at least one of acharacter string or a gestural input.
 15. The computer-implementedmethod of claim 7, wherein: the first instruction comprises a request todisplay or store the additional content item; and the second instructionis operable to cause the controlled device to display or store theadditional content item.
 16. An apparatus, comprising: a processor forexecuting program instructions; and a memory storing the programinstructions, the program instructions being executed by the processorto perform a process to: transmit, to a control device, a digitalcontent item and data regarding one or more content elements within thedigital content item; receive, from the control device, a selection of afirst content element of the one or more content elements, wherein thefirst content element is selected during presentation of the digitalcontent item at the control device; transmit, to the control device,data regarding one or more additional content items related to the firstcontent element; subsequent to transmitting the data regarding the oneor more additional content items related to the first content element,receive, from the control device, a first instruction associated with anadditional content item of the one or more additional content items;generate a second instruction, wherein: the controlled device is notincluded with the control device; the controlled device is controllableby the control device; and the second instruction is operable to causethe controlled device to obtain the additional content item consistentwith the second instruction; and transmit the second instruction to thecontrolled device.
 17. The apparatus of claim 16, wherein the programinstructions executed by the processor are further executed to:establish a communications session with the control device; andestablish a communications session with the controlled device.
 18. Theapparatus of claim 16, wherein: the second instruction is furtherunderstandable by the control device; and the program instructionsexecuted by the processor are further executed to transmit the secondinstruction to the control device.
 19. The apparatus of claim 16,wherein the first instruction comprises a request to retrieve contentassociated with an identifier, and wherein the identifier is associatedwith the additional content item.
 20. The apparatus of claim 19, whereinthe program instructions executed by the processor are further executedto: receive, from the control device, a third instruction comprising arequest to associate the identifier with the first content element;generate a fourth instruction understandable by the controlled device,wherein the fourth instruction is operable to cause the controlleddevice to associate the identifier with the first content element; andtransmit the fourth instruction to the controlled device.